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Abstract 

We provide some criteria on the stability of regime-switching diffusion processes. Both the 
state-independent and state-dependent regime-switching diffusion processes with switching 
in a finite state space and an infinite countable state space are studied in this work. We 
provide two methods to deal with switching processes in an infinite countable state space. 
One is a finite partition method based on the nonsingular M-matrix theory. Another is 
an application of principal eigenvalue of a bilinear form. Our methods can deal with both 
linear and nonlinear regime-switching diffusion processes. Moreover, the method of principal 
eigenvalue is also used to study the recurrence of regime-switching diffusion processes. 
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1 Introduction 


In this work, we shall study the stability of regime-switching diffusion processes (for short, 
RSDP) which arise in financial engineering, wireless communication and many other application 
fields. The stability of such systems is of great interest and there has been a great deal of 
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study in this topic; see for example, nuuEuziEuinuiiuizunusnuzi] and references therein. 
Especially, stability of linear or semi-linear type of such systems has been investigated by [21 El H31 
among others. These works generalized the Lyapunov’s second method to deal with the regime¬ 
switching diffusion processes. In particular, for linear systems, some easily verifiable conditions 
were provided to ensure the stability or instability of regime-switching processes. It is well known 
that the construction of Lyapunov function is a rather difficult task, so it is of great value to 
find some easily verifiable conditions to ensure the existence of desired Lyapunov functions. The 
main aims of this work are twofold: one is to find some easily verifiable conditions to justify the 
stability or the instability of nonlinear regime-switching processes; another is to generalize these 
conditions to study the stability of state-dependent regime-switching processes in an infinite 
countable state space. Up to our knowledge, there is few result on the stability of regime¬ 
switching processes in an infinite countable state space. Besides, there are some discussion on 
the stability of a linearized system with the stability of the initial nonlinear system in [BJ Chapter 
7]. There R. Khasminskii gave some positive answer. On the other hand, we should note that 
there are essential difference between the stability of nonlinear system with that of linear system. 
On the stability of nonlinear control system, both the well-known conjectures of Aizerman and 
Kalman were proven wrong by counter-example. 

The regime-switching process considered in this work consists two components, (At, At). 
The first component (Xt) satisfies a stochastic differential equation with coefficients depending 
on the process (A*); the second component (At) is a continuous time Markov chain on a finite or a 
countable space. One can view the process (Xt) as a diffusion process in a random environment 
characterized by the process (At). The stability of (Xt) in a random environment is more 
complicated than that of a diffusion process in a fixed environment. There are many examples 
(see [12] , [21J concrete examples) to show that when (Xt) is stable in some fixed environments 
and unstable in other fixed environments, one can make (Xt) to be stable or unstable by choosing 
suitable switching rate, i.e. the Q-matrix of (At). In this work, we shall provide some on-off 
type criteria to show how the switching rate (Q-matrix) and the stability of (Xt) in each fixed 
environment work together to determine the stability of the process (At, At). In this work, the 
stability only means the asymptotic stability in probability of the system (At, At). Other kinds 
of stability (for instance, p-stability) are left for further work. 

To see the usefulness and sharpness of our criteria, let us consider the following one- 
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dimensional nonlinear system. 

dX f = b At ( X 2 A |X*|)dt + <r At ( X 2 A \X t \)dB t , 

where (At) is a continuous time Markov chain in a finite state space At, bi , <r* are constants for 
each i £ At. Here we use x 2 A |x| := min{x 2 , |x|} to guarantee the solution of previous SDE 
to be nonexplosive, which does not impact the nonlinearity of the system near 0. Let /x be the 
invariant measure of (At). Applying our criteria, we show that x = 0 is asymptotically stable in 
probability if YIigM mA < 0, and is unstable in probability if / J A > 0 (see Corollary 12.91 

below). 

In [151116] . the recurrence of RSDP in Wasserstein distance and in total varitional norm has 
been studied. In this work, we develop their ideas to study the stability of RSDP. We mention 
some difference between the study of ergodicity and that of stability for RSDP compared with 
mm- Both of these studies try to construct a Lyapunov function V ( x , i) such that stf V(x, i ) < 
0, where srf denotes the infinitesimal generator of RSDP. When we study the ergodicity, the 
key point is the behavior of V(x,i) in the neighborhood of oo, but to study the stability, the 

key point is the behavior of V(x,i) in the neighborhood of 0. Note the following obvious fact: 
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lim^oo 2L- = oo but lim.r-j.o = 0. Consequently, the dominant terms in srf V(x, i) are different 
in these different situations. 

This work is organized as follows. In Section 2, we first provide two kinds of criteria 
for stability of RSDP in a finite state space, which are based separatively on the Friedholm 
alternative and nonsingular M-matrix theory. Then in subsection 2.2, we extend the criterion 
in terms of M-matrix to deal with RSDP in a countable state space by putting forward a 
finite partition method. This method can also be used to deal with state-dependent RSDP. In 
Section 3, we provide some criteria for stability of RSDP in terms of the principal eigenvalue 
of a bilinear form. The method can deal with RSDP in a finite or countable state space. 
Compared with the method in terms of M-matrix theory, this criterion can deal with switching 
process in a countable state space without assuming the boundedness of the jumping rates. In 
Section 4, we apply the principal eigenvalue to study the recurrence of RSDP. Moreover, we 
provide a lower estimate of the principal eigenvalue defined in our work, which generalizes the 
corresponding result for the principal eigenvalue of Dirichlet forms in |4]. Two concrete examples 
are constructed to show the usefulness of this method in dealing with RSDP with unbounded 
jumping rates. 
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2 Criteria based on M-matrix theory and Friedholm alternative 


The regime-switching diffusion process studied in this work can be viewed as a number of 
diffusion processes modulated by a random switching device or as a diffusion process which lives 
in a random environment. More precisely, RSDP is a two-component process (Xt,A t), where 
(Xt) describes the continuous dynamics, and (At) describes the random switching device. (X t ) 
satisfies the stochastic differential equation (for short, SDE) 

d X t = b(X t , A t )d t + <r(X t ,A t )dB t , X 0 = x £ R d , (2.1) 

where (Bt) is a Brownian motion in M d , d > 1, a is d x d-matrix, and b is a vector in R d . While for 
each fixed x £ W l , (At) is a continuous time Markov chain on the state space Ai = {1,2,... , IV}, 
2 < N < oo, satisfying 

Pi A 71A i v a / Qki(x)5 + o(6), if k^l, 

F(A t+s = l\A t = k,X t = x) = < (2.2) 

[ 1 + qkk(x)o + o(d), itk = l, 

for 6 > 0. The Q-matrix Q x = (qki(x)) is irreducible and conservative for each x £ M d . If the 
Q-matrix (qu(x)) does not depend on x, then (X t ,A t ) is called a state-independent RSDP; 
otherwise, it is called a state-dependent one. When N is finite, namely, (At) is a Markov chain 
on a finite state space, we call (Xt, A*) a RSDP in a finite state space. When N is infinite, we 
call (X t ,A t ) a RSDP in an infinite countable state space. 

To proceed, we introduce some conditions on the coefficients so that the solution of SDE 
(12.11) (I2.2p exists and 0 is the unique equilibrium point of this random dynamic system. There¬ 
fore, the stability studied in this work is mainly focused on whether the equilibrium 0 is stable 
or not. Hence, it is natural to assume that the process is not explosive, which is ensured by the 
linear growth condition. In what follows, we introduce some conditions used in this work. 

(H2.1) (qtj(x)) is conservative and irreducible for each x £ R d . For each x £ K rf , i £ Ai, 
rn X) i := sup{j £ Ai; qtj(x) > 0} < oo. There exists a constant C such that Ylj^iJ 2( lij( x ) — 
C( 1 + \x\ 2 ) for every x £ R d , i £ Ai. For each n £ N, there exists a constant C n such that 

\qij(xi) - qtj(x 2 )| < C n \xi - x 2 \, xi, x 2 £ F d , |xi| < n, \x 2 \ <n, i / j £ Ai. 
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(H2.2 ) 6(0, i) = 0 and cr(0, *) = 0 for each i £ A4. Moreover, for any sufficiently small 0 < e < ro, 
there exist l £ {1,... ,d} and n(e) > 0 such that au(x,i) > k(e) for all ( x,i ) £ {x;e < 
\x\ < ro} x M. , where a(x,i ) = cr(x,i)cr(x,i)*. 

(H2.3) For each n £ N, there exists constant K n so that \b(x,i)\ + ||<7(x,i)|| < K n ( 1 + |x|), for 
x £ E d , \x\ < n, i £ M. 

(H2.4) For each n £ N, there exists constant K n > 0 so that 

\b(x,i) - b(y,i)\ + || a(x,i) - a(y,i )|| < K n \x -y |, V®, y £ R d , |x| < n, \y\ <n, i £ M. 

Here and in the sequel, a* stands for the transpose of matrix a, and ||oj| denotes the operator 
norm. When A4 is a finite set, according to [21], conditions (H2.1), (H2.3) and (H2.4) ensure 
the existence of a nonexplosive solution (A}, A t) of (12.11) and (12.21) . When Ai is an infinite 
countable set, according to the theory of SDE driven by Levy process, conditions (H2.1), (H2.3) 
and (H2.4) also ensure the existence of a nonexplosive solution of (12.11) and (12.21) . Indeed, by 
[6], the jump process (At) can be represented by a stochastic integral w.r.t. a Poisson random 
process. Precisely, for each x £ R d , i, j £ A4 with i ^ j, let A L j{x) be a consecutive (w.r.t. the 
lexicographic ordering on A4 x A4), left-closed, right open intervals on the real line, each having 
length qij{x). Namely, 

Ai 2 (x) = [0,<?i 2 (x)), A i3 (x) = [qi 2 (x),qi 2 (x) + qi 3 (x)), 


m x , i-l m Xt i 

A lm I ,lW = [ Y 9lj(x), Y 

3 =2 3 =2 

A 2 i(x) = [ Y j(x), Y < Hj(x) + Q 2 i(x)), 

3 =2 3 =2 

and so on. Let h :R d x M. xR —> M be defined by 

'mx,i 

h(x,i,z ) = -*) 1 a«(*)W- 

i=i 

Then (12.21) is equivalent to 

dA t = [ h(X t ,A t _,z)N(dt,dz), (2.3) 

4E 
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where N(dt,dz ) is a Poisson random measure with intensity d t x d z. Hence, by [18l Section 
II-2.1, pp.104], conditions (H2.1), (H2.3) and (H2.4) ensure the existence of the solution of (12.11) 
and m- Moreover, these conditions also ensure that there exists a constant C such that 

\Kx,y )\ 2 + \\a(x,y)\\ 2 + \\h(x,y,-)\\ L 2 {dx) < C( 1 + \x\ 2 + y 2 ), x € M . d , y € M. 

According to m Lemma 114], the solution of (12.11) and (12.21) is nonexplosive. 

We adopt the definition of stability given in R. Khasminskii [8|. See also [21, Chapter 7] or 
[9]. Precisely, the equilibrium point x = 0 is said to be stable in probability, if for any £ > 0 and 
any i £ M., 

lim P( sup \X x,i (t)\ >s)= 0, 

^->0 t> o 

and x = 0 is said to be unstable in probability if it is not stable in probability. Here (. X x ’ l (t )) 
denotes the first component of the solution of (12.11) . (12.21) with initial condition (Xq, Aq) = (x, i). 
The equilibrium point x = 0 is said to be asymptotically stable in probability , if it is stable in 
probability and satisfies 

lim P( lim X x,i (t) = 0) = 1, for any i € M.. 

x—>0 v t—>oo ' 

For the convenience of reader, we collect some results from ED on Foster-Lyapunov criteria 
for RSDP. Let s? be the infinitesimal generator of (Xt, At) which is expressed by 

^f(x,i ) = + Qf(x, ■)(*), 

where 

1 d q 2 d Q 

LW = 2 ^ dx ~3 Xl + £ and Q= ^ Qij ^ 9j ~ 9i) ' 

k,l =1 fc=l 

Since the situation that A4 is an infinite countable set is considered, we need to extend the 
criteria established in [21, Chapter 7] for RSDP in a countable state space. The main idea 
is similar, but some new techniques are needed. For the ease of the reader, we give out these 
results. 

Lemma 2.1 Suppose that the conditions (H2.1) (H2.2) hold. Then 

P (X x,l (t) ^ 0, t > 0) = 1 for any i/O , i £ Ai, 
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and for any p G M, t > 0 


E[|X !e > i (t)| p ] < \x\ p e Kt , x^O, i € AA, 
where K is a constant depending only on p and Lipschitz constant K. 

Proof. When A4 is a countable set, this lemma can be proved in the same way as that of 
;2T . Lemma 7.1]. But we should note that the constant K could be taken independent of the 
cardinality of AA in their proof. ■ 

Lemma 2.2 Assume that (H2.1) (H2.2) hold. Let D C M. d be a neighborhood of 0. Suppose 
that there exists a nonnegative function V(-,i) ■ D —> R such that 

(i) V(-,i) is continuous in D for each i £ AA and infj G ^vi V(x,i) vanishes only at x = 0; 

(ii) V(-,i) is twice continuously differentiable in U\{0}, and satisfies &/V(x,i) < 0 for all 
x € -D\{0}, i e AA. 

Then the equilibrium point x = 0 is asymptotically stable in probability. 

Proof. This lemma can be proved in the same way as that of [211 Lemma 7.5]. There they used 
the condition that V(x,i) vanishes only at 0 for each i G AA. So when N < oo the condition (i) 
here is equivalent to the condition in [ 2Tj, Lemma 7.5]. But when N = oo, we use condition (i) 
which ensures that the proof of |2T, Lemma 7.5] is still valid. So the equilibrium point x = 0 is 
stable in probability. By Remark 7.8 in [21], we can prove that the equilibrium point x = 0 is 
asymptotically stable in probability in the same way as that of m Lemma 7.6]. ■ 

Lemma 2.3 Let D C W l be a neighborhood of 0. Suppose that (H2.1) and (H2.2) hold, and 
for each i € AA, there exists a nonnegative function V(-,i) : D —> R such that V(-,i) is twice 
continuously differentiable in _D\{0}. Suppose that 

g/V(x,i) <0 for all x 6 H\{0}, i € AA, (2-4) 

lim V(x,i) = oo for each i G AA. (2-5) 

Then the equilibrium point x = 0 is unstable in probability. 
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Proof. Let £ > 0 such that the closed ball B £ = {x; |x| < C} is contained in D, and (x,i) G 
B ^ x At. Letting 0 < e < \x\ and m G N , m > 2, define 

t £ = infjt > 0; \X x ’ l (t)\ < e}, r c = inf{t > 0; \X x ’ l (t) > C}, 

Te,m = inf {t > 0; |X x,l (t)| < e, A t G {!,... ,m}}. 


Then it is obviously that r e;m > r e . By Ito’s formula, 

E [V(X(t A 7£ A r £jm ), A(t At( A r £ , m ))] = P(x,i) + E 

< P(x,i). 


I 


tAr ? Ar e , m 


^/P(X„A s )ds 


Letting t —>• oo, we get by Fatou’s lemma 


E[V(X(t c Ar £ , m ),A(r( Ar EiTn ))] < V(x,i). 


As V is nonnegative, we obtain 


P(x,i) > E[P(X(r £!m ),A(r £ , m ))l {T£jm<Tc} ] 

> inf P(y,j)P( r C > T e,m) 

= inf V(y,j) P( sup |X(i)|<C). 

\y\<£,j<m 0 <t<T s ,m 


( 2 . 6 ) 


Here we should note that at the time r e;m , it is possible that |A'(r £;m )| < e. By Lemma [2TT1 we 
have t £ — > oo almost surely as e —>■ 0. Indeed, set A = {u : to(u) := lim £ _^o r e (w) < oo}. For 
w G A, as |X Te (w)| = e, we get |X To (a;)| = 0. If P(A) > 0, then P(A} = 0 for some t > 0) > 
P(A) > 0, which contradicts the result of Lemma l2Al Hence r £;m —> oo almost surely as e —> 0. 
By (12.51) . it holds lim^oinf| y \< e j< m V(y,j) = oo. Consequently, (|2.6I) yields 


P( sup \X t \ < £) =0, 
t> o 


which shows that the equilibrium point x 


0 is unstable in probability. 


2.1 State-independent RSDP in a finite state space 

In this subsection, we mainly want to deal with the difficulty generated by the nonlinearity of the 
system, and leave the difficulty generated by the state-dependence and infiniteness of switching 




to the next subsection. Therefore, in this subsection, Q-matrix (q t f) is independent of x and A4 
is a finite set, i.e. N < oo. 

Now we introduce two conditions used later to characterize the stability of (Aft) in each fixed 
environment. Let D be a neighborhood of 0. Let p, h : D —> [ 0, oo) be nonnegative functions 
such that p, h are twice continuously differentiable in D\{0}. 


(Al) For each i £ Aft, there exists a number ft Gl such that 

L®p(x) < j3ih(x ), Vx€L>\{0}, 

and 

. h(x) , L^h(x) 

lim —— = 0, Inn--— = 0. 

a:—>0 p(x) x-tO h(x) 

(A2) For each i € Aft, there exists a number ft gK such that 

p{x) < j3ip(x), Vs € D\{0}. 


Note that here /ft and /ft are allowed to be positive or negative. When p(x) vanishes only at 0, 
the negativeness of /ft and ensures that the equilibrium point is stable in probability for the 
diffusion process associated with (Aft) in the fixed environment i. 

Next, let us introduce our first criterion for stability of RSDP based on the Friedholm 
alternative, which can provide us some on-off type criteria for RSDP . 

Theorem 2.4 Let (Aft, A t ) be a state-independent RSDP satisfying \2.1\) 112.2 1) with N < oo. 
Assume (H2.1)-(H2.f) hold. Let p, h £ C 2 (D) be two nonnegative functions satisfying (Al). 
Let p be the invariant probability measure of (A*). Suppose that 

X] < o. (2.7) 

ieM 

Then the equilibrium point x = 0 is asymptotically stable in probability if p(x) vanishes only at 
0, and is unstable in probability if lim^^o p{%) = oo. 

Proof. Since /A/ft < 0, according to the Friedholm alternative (cf. [13])) there exists a 

constant c > 0 and a vector £ such that 

Q£(i) = — c — /ft for every i G M. 
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Set V(x,i) = p(x) + £ih(x) with the vector £ = (£ 1 , ■ ■ ■ ,£jv)* determined above. We have 


V(x, i) = L® p(x) + Q£(i)h(x) + ^L^h(x) 

/ T^h(r)\ ( 2 - 8 ) 

By (12.81) . we obtain 

s&V(x,i)< ( -c + ^ L ) h(x), x € D\{ 0}. (2.9) 


L®h( a 


= 0, for some 0 < e < |, 


Since (£*)(=! is bounded due to the finiteness of N, and lim 

x >0 fLyCC ) 

there exists <5i > 0 such that for any x G D D {z; 0 < \z\ < <5i}, one has | & L< "h{x)^ 
hence £/V(x,i) < —^h(x) < 0. Now we check the nonnegativity of V{x,i). By (Al), we have 
lim x ^o 1 + y = I; so there exists 62 > 0 such that for any x G {z; \z\ < 82 } fl D, 


< e < |, and 


1 


+ ! M~ 1 r and v(xJ) = p{x) i l + ^ (l) - °- 


This also implies that if lim x ^ 0 p{x) = 00 , then lim x ^o V(%, i) = 00 for every i G A4. Moreover, 
by the definition of V(x,i ) and the condition lirn x ^o = 0, it is easy to see that if p[x) 
vanishes only at 0, then V(0, i) = lirm^o V(x, i) = 0 and V(x,i) vanishes only at 0. Set 
D = D fl {z; \z\ < min{<5i, ^ 2 }} being a neighborhood of 0, then 


sf V(x, i) < 0, V (x, i) G T>\{0} x M. 


Applying Lemma 12.21 and Lemma 12.31 we can conclude the proof. ■ 

Next, we give out a criterion based on the theory of M-matrix. In [12] . the theory of M- 
rnatrix has been used to study the stability of linear state-independent regime-switching diffusion 
processes. In this work, we generalize this method to deal with more general regime-switching 
diffusion processes. As an application of this method, an example of nonlinear regime-switching 
diffusion process in a countable state space is given in subsection 2.2. 

Let us first introduce some basic facts on the theory of M-matrix. Let B be a matrix or 
vector. By B > 0 we mean that all elements of B are nonnegative. By B > 0 we mean that 
B > 0 and at least one element of B is positive. By B > 0, we mean that all elements of B are 
positive. B <C 0 means that —B 3> 0. 
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Definition 2.5 (M-matrix) A square matrix A = (aij) nxn is called an M-Matrix if A can be 
expressed in the form A = si — B with some B > 0 and s > Ria(-B), where I is the nxn identity 
matrix, and Ria(-B) the spectral radius of B. When s > Ria(R), A is called a nonsingular M- 
matrix. 


Below, we cite some equivalent conditions that A is a nonsingular M-matrix and refer the reader 
to [3] for more equivalent conditions. 

Proposition 2.6 ([3],[12]) The following statements are equivalent. 


1. A is a nonsingular nxn M-matrix. 

2. All of the principal minors of A are positive; that is, 


an ... a 


C 1 k ■ ■ ■ CLfck 


> 0 for every k = 1, 


3. Every real eigenvalue of A is positive. 

4- A is semipositive; that is, there exists x » 0 in M n such that Ax 3> 0. 


Theorem 2.7 Let (X t , A t ) be state-independent RSDP satisfying 112. 11) \2.2\) with N < oo. 
Assume (H2.1)-(H2-4) hold. Let p £ C 2 (D ) be a nonnegative function such that (A2) holds. 
Suppose that 

— [Q + diag(/3i,..., Pn)) is a nonsingular M-matrix , (2-10) 

where diag(/3i,..., Pn) denotes the diagonal matrix generated by the vector (/3i,..., Pn)* cls 
usual. Then the equilibrium point x = 0 is asymptotically stable in probability if p{x) vanishes 
only at 0, and is unstable in probability if liur c _ > .o p(x) = oo. 


Proof. As — (Q + diag(/?i, ... ,/3jv)) is a nonsingular M-matrix, there exists a vector £ = 
(£i,..., 6v)* ^ 0 such that 

A = (Ai,..., \ N )* := -{Q + diag(/3i,... ,/3jv))£ » 0. 

Set V{x,i) = fip{x) for x € ZA\{0} and i £ M., then 

g/V(x,i) = Qf(i)p{x ) +£jL w p(x) 

< + Mi)p{x) = -A ip(x) < 0. 


Ti¬ 


ll 





Applying Lemma 12.21 and Lemma 12.31 the desired conclusion follows immediately. 


Now we apply our criterion to study the stability of a class of nonlinear RSDP. Let (Xt, At) 
satisfy m and (12.21) . We assume further that 


b(x, i) = |x| 7 6(x/|x’|, i)(l + o(l)), a(x, i) = \x\^ cr(x/\x\,i)(\ + o(l)) 


( 2 . 11 ) 


as x —> 0, where b(-, •) : S d ~ ] x AA —> M d , <t(-, •) : 5 d_1 x M. —> W dxd , b and a are continuous, 
1 < 7 < 2^ — 1 and S d ~ 1 denotes the unit sphere in M d . We dehne some quantities used later. 
Denote by 6 = (9 \,... ,9d)* a point in S^ -1 . Denote by dk(-) the Dirac measure at k. Put 
a(9,i) = ij( 9, i)<j(9, i)*. For each i € Ai, set 


Pi = < 


sup EfcLi h{0,t)9k, 

ees *- 1 

"l v^iV 


sup 

ees d ~ 1 L 


\ 52k,i=i &ki(9, i) (Sk(l) - 2 9k9{) + 52k= i bk{9, i)9k 


and 


Pi = < 


inf Y,k=l b k(0,i)9 k , 

inf \52ki=i b 'kl{9,i){5 k (l)-29 k 9i) + 52k=i h{9,i)9 k 

0 £S d 1 L ’ 


if 7 < 2C - 1, 
if 7 = 2C — 1, 

if 7 < 2C — 1, 
if 7 = 2C- 1. 


( 2 . 12 ) 


(2.13) 


Theorem 2.8 Assume (H2.1)-(H2-4) hold. Suppose that (X t ,A t ) satisfies 112.1}) A 2.2 1) with co¬ 
efficients satisfying A2.11\) and 1 < 7 < 2£ — 1. Let (pf) be the invariant probability measure of 
(A t ). The equilibrium point x = 0 is asymptotically stable in probability if E)=i hi Pi < 0; an d 
is unstable in probability if 52iLi hi Pi > 0. 


Proof. Let 


1 N „2 N Q 

L W = -|x| 2 ^ V d k i(x/\x\,i )-— -h |x | 7 yZh(x/\x\,i) 

> OXkOXi 


k,l= 1 


k =1 


dxi 


(1) To prove that x = 0 is stable in probability, we choose p(x) = \x\ p (p > 0) and 
h(x ) = |x| 7+p_1 . Then 

N N 

L^p(x) = ||x| 2C+p_2 y a k i(9,i)((p - 2)9 k 9i + 5 k (l)) +p|x| 7+p_1 b k (9, i)9 k 


= p 


k,l =1 

I2C-1-7 N 


k =1 


N 


Y. a k i{9,i)((p - 2)9 k 9i + 5 k (l)) + y ^b k (9,i)9 k h(x) 


k,l =1 


k =1 
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where 9 = (6 1 ,.. ■, 9j\r)* = x/\x\. By direct calculation, one gets 

, h(x) L^h(x) 

lim ——— = 0 and lim ———-— = 0 . 

x-*o p(x) >0 h(x) 

If 7 < 2£ — 1, then for any e > 0 we can choose a <5i > 0 so that for any x £ {z; \z\ < <5i}, 
, I2C-1-7 N N N 

P ^ a k i(0,i)((p-2)9 k 6i + 5k(l)) + ^2b k (6,i)6 k < p(^b k (9,i)9 k + e 

k,l =1 k=1 k =1 

If 7 = 2f — 1, then for any e > 0, there exists po > 0 such that for any 0 < p < po, 

N N 


„| 2 C-! 


-1-7 


P CLki(0,i) {{p - 2 )0 k 9i + 4(0) + y^b k (9,i)9 k <p(Pi + £) 

k,l =1 k =1 

Invoking the condition (12.111) . by choosing a sufficiently small 5\ and p$, we have 

L^pfx) < p(/3i + e)h(x). 


By the arbitrariness of e > 0, by Theorem 12.41 we obtain that x = 0 is asymptotically stable in 
probability if p t P t < 0 . 

(2) We go to study the instability. Now let p(x) = \x\~ p (p > 0) for x ^ 0 and h(x) = 
| x | 7 -p-i. Then it hold lim x ^o 7777 = 0 and lim x ^ 0 ^ 7777 ^ = 0. Analogous to the discussion in 
part ( 1 ), through choosing a small neighborhood of 0 for x or a small value p, we obtain for any 

e > 0 


L^p(x) = p 


I2C-1 —7 


N 


N 


a k i(9,i)((p + 2)6 k 0i - 5 k (l)) ^b k (6,i)9 k h(x) 


k.l =1 


k =1 


< -p(Pi + E)h{x). 


Therefore, if YliLi PiPi > 0 , then x = 0 is unstable in probability by Theorem 12.41 ■ 

Theorem 12.81 shows that our on-off criterion provided by Theorem 12.41 could be very sharp. 
We can see it more clearly from the nonlinear systems in the 1-dimensional space. Let 


dX t = b At (\X t \'y/\\X t \)dt + a At (\X t \< A\X t \)dB t , in M, (2.14) 

and (At) is still a continuous time Markov chain on AA with N < 00 . Applying Theorem 12.81 to 
this situation, we can obtain immediately 


Corollary 2.9 Suppose (X t ,A t ) satisfy fl 2.1$ . Assume 1 < 7 < 2(— 1. Let /3i = bi if 7 < 2£ —1 
and f3i = bi~ ifj = 2(—l. Then the equilibrium x = 0 is asymptotically stable in probability 
if Ylr=i PiPi < 0 an d is unstable in probability if Pi Pi > 0. 
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2.2 State-dependent RSDP in a countable state space 


In this subsection, we consider the stability of state-dependent RSDP in a countable state 
space. Based on our results for state-independent RSDP in a finite state space, we shall put 
forward a finite partition method to transform the RSDP in a countable state space into a new 
RSDP in a finite state space. So in this subsection (X t .A t ) still satisfies (12.11) (|2.2I) but with 
N = oo and Q-matrix ( qij{x )) of (At) depending on x. 

Let p £ C 2 (D ) be a nonnegative function such that (A2) holds. As N = oo, in this 
subsection we need to assume M := sup )G7V( /% < oo. We first divide the space A4 into finite 
number of subsets according to the stability of (W) in each fixed environment. Precisely, let 

T = {—oo = kg < ki < ... < km -1 < k m = M} 


be a finite partition of (—oo,M]. Corresponding to T, there exists a finite partition F = 
{Pi,..., F m } of A4 defined by 

Fi = {j £ M; (3j £ (ki-i,ki]j, i = l,2,...,m. (2.15) 


We assume that each Fi is nonempty, otherwise, we can delete some points in the partition T. 
Set 


P 


sup fa, qP = 

j&Fi 


k^i 


(2.16) 


Qik 


sup xeK d sup reF . Y,j & F k Qrj (x), if k < i, 

inf^gRd inf reFi ?rj(*), if k > i, 


(2.17) 


for i, k £ M.. In order to ensure qf = —q? < oo for i = 1,... m, we assume that there exists a 
number M such 


sup sup qi(x) < M < oo. (2.18) 

xeRd ieM 


Then it is easy to see 


Pj < P[ , Vj £ F h and i = 


14 


Theorem 2.10 Let (Xf,Af) be a state-dependent RSDP in an infinite state space satisfying 
112 . 1 \) 12 . 21 ) . Assume that (H2.1)-(H2-4) and \2.18\) hold. Let p £ C 2 (D) be a nonnegative 
function such that (A2) holds and M = sup^g^ fit < oo. Suppose that the m x m matrix 
— (diag(/3f,..., fi F f) + Q h ) H m is a nonsingular M-matrix, where 


/ 1 

i 

1 •• 

' ^ 


0 

i 

1 •• 

• 1 


0 

0 

1 •• 

• 1 

(2.19) 

V° 

0 

0 •• 

• V 

mxm 


Then the equilibrium x = 0 is asymptotically stable in probability if p(x ) vanishes only at 0, and 
is unstable in probability if linx^o p(x) = oo. 


Proof. Since —(Q F +di&g(/3 [,..., is a nonsingular M-matrix, by Proposition ^. 61 there 

exists a vector rj F = (rj F ,..., p F f)* S> 0 such that 

A f = (Af,..., A F )* := ~(Q f + diag(/3f,..., fi F ))H m r, F » 0. 


Set f F = H m r] F . Then 

Cf = Vm H-H Vi , i = 

which yields that £[ +1 < for i = 1,..., m — 1 and f F 0. We extend £ F to a vector £ on A4 
by setting £j = f F if j £ Fi. Let fi : A4 —>• {1,... , m} be a map defined by fi(j) = k if j £ F}.. 
Let Q x g(i) = y2j^iQij( x )(gj — gf) for g £ 38 (M). Set V(x,i) = f,ip(x). By the definitions of 
Q f , fi F and the decreasing property of £f, we have, for r £ Fi, 


Qxf,{ r ) — 'y ' J Q.rj(x){fij £i) — y ^ Q.rjix){fij £i) 

dAr j<£Fi 

= (ST - ) 

k<i j£F k k>i j£F k 

< qfk(£k ~ t F ) + qfk(£k - Cf) = <2 F £ F (<K0)- 

k<i k>i 

Furthermore, 


£/V(x,r) = Q x f(r)p(x) + ^ r L {r) p{x) 

< (Q F £ F (0(r)) + P F {r) t, F {r) )p(x) 
= ~^<P(r)P( X ) ^ °- 
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Note that inf',; Gj vi V(x,i) = min i< m £,[p(x) vanishes only at 0, then applying Lemmas 12.21 and 
ES we can get the desired conclusion. ■ 


Remark 2.11 The function p(x) appeared in Theorem 12.101 is a test function, which we used 
to characterize the behavior of the process (Xt) in each fixed environment. Taking p(x) to be 
a polynomial function will work for many cases as being shown by our examples. After getting 
the constants fa, i £ Xi, one needs to classify the state space M. according to (fa). This part 
needs some skill. Other conditions of this theorem can be checked directly. 

Example 2.1 Let (Xt) be a process on R satisfying 

dX t = bA t X t dt + X 2 A \X t \ d B t , X 0 = x 0 fa 0, 

and (At) is a birth-death process on Ai = {1,2,...} with qa+i(x) = c, + (i — 1) sinx for i > 1 , 
qa-i(x) = CLi + (i — 2) sinx for i > 2, qtj(x) = 0 for any j £ {i — where a*, Cj are positive 

constants. Let (Ay ) be the diffusion process associated with (Xt) in the fixed environment i, 
that is, 

dxf ] = biX^dt + (X t (i) ) 2 A \xf\ dB t . 

It is easy to know that x = 0 is stable in probability for the process (x{^) if bi < 0, and is 
unstable in probability if bi > 0. By taking p(x) = \x\, it is easy to see fadp(x) = bi\x\ for x fa 0. 
So we have fa = bi in condition (A2). Take the partition as F\ = {1} and T 2 = {2,3,...}. Then 
Q12 = ci, q *:1 = 02- 

More precisely, we set b\ = — 1 and bi = k — 1 for some positive constant k. Then 

Pf = b\ = —1 and p![ = K ■ The matrix —(Q F + diag(/3f\ / 3 %))H 2 is a nonsingular M-matrix if 
and only if n < . Therefore, when k < , x = 0 is asymptotically stable in probability 

for (Xt, Afa according to Theorem 12.101 

3 Principal eigenvalue and stability of RSDP 

In this section we continue to study the stability of the equilibrium point x = 0 for the system 
given by and We shall provide some criteria in terms of the principal eigenvalue 

of a bilinear form. Let (X t ,A t ) be defined by (12.11) and (12.21) with state-independent (q t j) and 
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N < oo. In this section, we need to assume that (At) is reversible. To emphasize on this 
condition, we use ( 77 ) 1 & m to denote the probability measure such that 'Ktqtj = ftjqji, i, j £ Ai. 

Let D be a neighborhood of 0. Let p £ C 2 (D) be a nonnegative function and satisfy 

(A3) for each i £ A4, there exists a number 7 , £ R such that 

& ] p(x) < jip(x ), \x\ £ L»\{ 0 }, 


and 7 . ^ 0 . 

Let L 2 (tt) = {/ £ 3§(M)\ n ifi < 00 }, and denote by || • |] and (•, •) respectively the norm 
and inner product in L 2 (tt). Set 

^ N N 

£(/) = 2 S - fi¥ f e (3-i) 

ij=l j=l 

where ( 7 *) is given by (A3). The domain of this bilinear form @(£) is defined by 

@(£) = {/ G L 2 (tt ); £>(/) < 00 }. 

The principal eigenvalue of £(f ) is defined by 

A 0 = inf {£’(/); / £ 0(£), ||/|| = l}. (3.2) 

The notation f (/) is similar to the Dirichlet form for a Markov chain with killing, but in our case 
7 i could be positive which causes £(f) may take negative value for some / € L 2 (ir). Due to this 
fact, H/ll! := ||/|| 2 + £(f) is no longer a norm. Some new difficulties appears when we provide 
a lower bound of Ao compared with the estimate of lower bound of the principal eigenvalue of a 
Dirichlet form. 

Next, we apply the principal eigenvalue to study the stability of (X t ,A t ). 

Theorem 3.1 Suppose that (H 2 . 1 ) (H2.2) hold and N < 00 . Assume that (At) is reversible 
w.r.t. the probability measure (iti). Let p £ C 2 (D) be a nonnegative function such that (A3) 
holds. £(f) and Ao are defined by \3.1 \ ) and \3.2\) as above. Assume Ao > 0. Then the equilibrium 
point x = 0 is asymptotically stable in probability if p(x) vanishes only at 0 and is unstable in 
probability if lim^o p(x) = 00 . 
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Proof. Let 


(3.3) 


^/(*) = Qf(i) + lift = ^2 Qijifj - fi) + 7 ifi for / e 3>(D). 

i¥=i 

Then £(f) = (f , —Llf). When N < oo, Ao must be the minimal eigenvalue of the operator —Cl 
by the variational representation of the eigenvalues of finite matrices. Let g be an eigenfunction 
corresponding to Ao- Since £(g) > £{\g\), it holds that g > 0. It is easy to see g fi 0. So there 
exists a A: € Ad such that g^ > 0. If qik > 0 for some i G Ad, then 

0 < qikQk < ^2 QijSj = (Qi ~ h ~ A 0 )gi- 

j¥=i 

This yields that gi > 0 and qi — 'fi — Xq > 0. As Q is irreducible, we can prove inductively that 

gi > 0 for each i G Ad. Moreover, Ad is a finite set now, so min,; G _,vt gi > 0. 

Let V(x,i) = gtp(x) for x £ D, i G Ad. Due to (A3), we have 

£?V(x,i) < ( Qg(i ) + 'f i g i )p{x) = -A 0 gip(x) <0, x £ D\{0}, i G Ad. 

If linx^o p(x) = oo, we have lum^o V(x, i) = linx^o gip(x) = oo for each i G Ad. Hence, by 
Lemma 12.31 the equilibrium point x = 0 is unstable in probability. 

If p(x) vanishes only at 0, due to the finiteness of N, we have 

inf V(x,i) = (min gA p{x) 
i£M v i&M ' 

also vanishes only at 0. Applying Lemma 12.21 we can get the desired result. ■ 

Theorem 3.2 Suppose that (H2.1) (H2.2) hold and N = oo. Assume that (At) is reversible 
w.r.t. the probability measure (iti). Let p G C 2 (D ) be a nonnegative function such that (A3) 
holds. £{f) and Ao are defined by 13. II) and \3.2\) as above. Assume Ao > 0 and Ao is attainable, 

i.e. there exists g G L 2 (tt), g ^ 0, such that £{g) = Ao||g|| 2 . Then 

(i) the equilibrium point x = 0 is unstable in probability if lim x ^o p( x ) = oo. 

(ii) Assume further that liminf^oc gi fi 0, then the equilibrium point x = 0 is asymptotically 
stable in probability if p(x) vanishes only at 0. 
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Proof. We first show that g 0 and Qg(i) + 77 /,; = —Ao gi, i £ M. To obtain this, we use 
the variational method as in [3j. It is easy to check £(/) > £(1/1), so it must hold g > 0. For a 
fixed k € A4, let gi = gi for i / k and g k = g k + e. It holds Qg(i ) = Qg(i ) + for i ^ k and 
Qg(k) = Qg(k) — eq k . We have 

N 

£{g) = (a, -Qg ) - X] 7r * 7 ^* 2 
2—1 
N 

= {g, -Qg) - X 7r * 7 *^ 2 + 2e7T k(-Qg)(k) - 2s7r k 'y k g k + £ 2 TT k {qk - 7 &)> 

Z =1 

where we have used the fact TTiqi k = tt k q k i. Because £(<)) > Ao ||^|| 2 and £(< 7 ) = Ao||fl'|| 2 , we get 

- 2 en k (A 0 g k + Qg(k ) + 7 /^) + £ 2 ir k (qk ~ Ik) ~ X Q £ 2 TT k > 0 . (3.4) 

Dividing both sides of (13.41) by £ > 0 and then letting £ —> 0 + , we get Qg(k ) + 7 ^ + Ao^fc < 0. 
Dividing both sides of (13.41) by £ < 0 and then letting £ —>• 0 _ , we get Qg{k) + 7 k g k + Xog k > 0. 
Therefore, Qg(k ) + 7 k g k = —Ao g k - Since k is chosen arbitrarily in A4, we have Qg(i ) + 7 iffi = 
—Ao 5 * for each i £ M.. 

Since <7 ^ 0 and g > 0, there exists k such that g k > 0. If qt k > 0, then 

0 < qikgk < X 'ADD = “ 7i - Ao)flL 

j¥=i 

so gi > 0 and % — 7 * — Ao > 0. As Q is irreducible, by an inductive procedure, we can prove 
that gi> 0 for every i £ M. 

Next, set V(x,i) = gip{x ) for x £ R d , i £ M.. We obtain for |x| >ro,i£ M., 

£/ V(x, i) = Qg(i)p{x ) + giL® p(x) 

(3.5) 

< {Qg(i) +7 m)p(x) = -A 0 gip(x) < 0. 

If lim x _>.o p(x) = 00 , then for each i £ A4, we have lina^o V(x,i) = linx^o gip{x) = 00 . By 
Lemma 12.31 we can prove the assertion (i). Under the condition liminf gi 7 ^ 0, we get that 
inf i£M gi > 0. Therefore, when p(x) vanishes only at 0, we can obtain that infj gj v( V(x,i) = 
(infjgjK gi)p(x ) still vanishes only at 0. Then the assertion (ii) follows from Lemma l2.2l and we 
complete the proof. ■ 
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Using the principal eigenvalue to study the stability of (Xt,At) when N = oo, we don’t 
need to assume the boundedness of Q-matrix and the vector ( 7 *) given by (A3). We construct 
an example of nonlinear RSDP to show its usefulness. We shall give a lower bound estimate of 
Ao in next section. 

Example 3.1 Let (Xt) be a process on R satisfying 

dX t = HA t X t dt + Xl A \X t \dB t , X 0 = x 0 + 0, (3.6) 

where a Ab = min{a, 6 }, and po = —c, pi = 7 for i > 1, c, 7 are positive constants. (A t ) is a 
birth-death process on M. = {0,1,...} with qu+i = bi = b(i + 1), qu-\ = a* = a(i + 1). Taking 
p(x ) = \x\, then p(x) = Pip(x) for x / 0. Set gt = i + 1. If a — 6 — 7>0 and c — b > 0, 
then there exists A > 0 such that £lg(i) < — Agi, i > 0. So Ao > A > 0 by Theorem 14.41 below. 
Noting inf gi = 1 >0, by Theorem 13.21 the equilibrium point x = 0 is asymptotic stable in 
probability if a — b — 7>0 and c — b > 0. 

4 Principal eigenvalue and recurrence of RSDP 

In this section, we shall provide some criteria for the recurrence of RSDP in terms of the 
principal eigenvalue of a bilinear form. In HS1. we have provided some explicit criteria for the 
recurrence of RSDP. But there when dealing with switching in a countable state space, we need 
to assume the boundedness of Q-matrix. In this part, we shall take advantage of the principal 
eigenvalue to provide a criterion for recurrence of RSDP without the boundedness assumption 
on the Q-matrix. 

Let (X tl A t ) satisfy ( 12.111 ( 12.211 with (qij) being state-independent. Assume ( A t ) is reversible 
w.r.t. the probability measure We use the following condition on the coefficients of 

(Xt, At) in this section. 

(H4.1) There exists a constant K such that 

\b(x,i)\ + ||cr(x, i )|| < K( 1 + |x|), x € M d , i € M, 

| b(x,i) - b(y,i)\ + ||(r(a:,i) - cr(y,i )|| < K\x - y\, x G R d , i € M, 
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Let p £ C 2 (R d ) be a positive function satisfying 

(A4) for each i £ A4, there exists a number 7 * £ R such that 

L^p(x) < 7 ip(x), \x\ > r 0 

for some ro > 0. Moreover, 7 . ^ 0. 

We can define the bilinear form £(f) and it principal eigenvalue Ao by (13.11) and (|3.2I) similarly 
by using ( 7 j) given by (A4). 

Theorem 4.1 Suppose that (H4-1) holds and N < 00. Suppose that (At) is reversible w.r.t. a 
probability measure ( 77 ). Let p £ C 2 (R rf ) satisfy p > 0 and (A4). Assume Ao > 0. Then (X t ,A t ) 
is positive recurrent if lim | a ,|_> 00 p(x) = 00 and is transient if lim | a ,|_> 00 p(x) = 0 . 


Proof. When N < 00 , Ao must be the minimal eigenvalue of the operator —f2. Let g be an 
eigenfunction corresponding to Ao- Then g must be positive, i.e. for each i £ Ai, gt > 0 and 
hence minj gj vi gt > 0 due to the finiteness of N. This fact follows from the irreducibility of (q t j) 
and the minimal property of Aq. Let V(x,i) = gip(x) for x £ R rf and i £ Ai. By (Al), we have 


£/V(x,i) = Qg(i)p(x) + p(x) 

< (Qg{i) +7 i 9 i)p(x) = -A 0 gip(x) 


(4.1) 


Therefore, if limM^^ p(x) = 00 , there exist positive constants e and ro > 0 such that gtp(x) > 
e > 0 for every |x| > ro, i £ A4. Applying the method of Lyapunov function (see m Section 2]), 
(X t ,A t ) is positive recurrent. If lim| x i _^ 00 p(x) = 0, then (X t ,A t ) is transient due to inequality 
(14.11) and the method of Lyapunov function. ■ 


Theorem 4.2 Suppose that (Hf.l) holds and N = 00. Suppose (At) is reversible w.r.t. a 
probability measure (77). Let p £ C 2 (R d ) be a positive function such that (A 4 ) holds. Assume 
that Ao > 0 and Ao is attainable, i.e. there exists g £ L 2 (ir), g ^ 0 such that £(g ) = Ao||s , || 2 . 
Then (X t ,A t ) is transient if liniM^,^ p(x) = 0 . Assume further that liminfj_ i > 00 gj 7 ^ 0 , then 
(X t , A t ) is recurrent if lim^i^oo p(x) = 00. 


Proof. Similar to the argument of Theorem 13.21 it holds that for each i £ Ai, Llg(i) = —Ao g% 
and g % > 0. Let V(x,i) = gip(x) for x £ R d , i £ Ai. We have for |x| >ro,i£ Ai, 

s#V(x,i) < (Qg(i) +7 igi)p(x) = - X 0 gip(x ) < 0 . 
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Let 


r = inf {t > 0; (X t ,A t ) € {x G R d ; |x| < r 0 } x {1, ... ,m 0 }}, 

where m o is a fixed finite number. Applying Ito’s formula to (A}, A t) with Xq = x, Aq = l, and 
\x\ > ro, l > m o, we obtain 

rtAr 

EV(X tAr ,A tAT ) = V(x, l) + E / si V(X S , A s )ds < V(x, l ) = ^p(x). (4.2) 

Jo 

Case 1. When lim| x i_ >00 p(x) = 0, if P(r < oo) = 1, then passing t to oo in (14.21) . we obtain 

r inf p(y) min gi <R[p(X T )g(A T )\ < gip(x). (4.3) 

{y,\y\<ro} *< m o 

Since the set {y\ \y\ < ro} x {1,... ,mo} is compact and the functions p and g are positive, the 
left-hand side of (14.31) is strictly positive. Since x is arbitrary, letting |x| —> oo, the right-hand 
side of (14.31) tends to 0, which is a contradiction. Therefore, P(r < oo) > 0 and (. X t ,A t ) is 
transient. 

Case 2. When limui^oo p{x) = oo, we consider another stopping time 

tr = inf {t > 0; \X t \ > K). 

As the process (X t ,A t ) is nonexplosive, tk increases to oo a.s. as K —> oo. Since lirri inf'^oo g t / 
0 and we have proved that g > 0, we get inf 9 i > 0. By Ito’s formula, we get 


® \9{^-tATKA t) p{Xt A r K At)] — p{p^)9l- 


This yields 


P(t > t k ) < t 


p(x)gi 


' mi {y,\y\>K} p{y ) infiex 9i 
Since limi a ,i_ ) . 0O p[x) = oo, we obtain that inf { y; \ y \>K} P(y) —> oo as K —> oo and 

p{x)gi 


(r = oo) < lim T 


K^>co inf{ y; |y|>A-j p(y) inf ieM 9i 


= 0 . 


Therefore, P(r < oo) = 1 and the process (Xt,At) is recurrent. ■ 

To apply our criteria, it is necessary to check the condition Ao > 0. There are many works 
and methods devoted to the estimate of the eigenvalues of Dirichlet forms. Next, we generalize 
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the lower estimate of the principal eigenvalue of a Dirichlet form given in [3|. The usefulness of 
this lower estimate will be seen from the examples given in the end of this section. Following 
the approach of [3], we first establish a variational formula for the bilinear form £(/) defined by 

m- 

Proposition 4.3 Assume that {qf)i^M an d (|7i|)ie.M ore bounded. Let f £ L 2 (ir) be nonnega¬ 
tive, then 

£(f) = sup {f 2 /g,-n g ), 

9 

where the supremum takes over all measurable functions g which are strictly positive (i.e. g > 
c g > 0 for some constant c g ). Furthermore, if there exists strictly positive g such that Ltg < —A g 
for some X > 0, then Aq > A. 


Proof. 1) Let g = glf^o, then (f 2 /g, —Llg) < (f 2 /g, —Llg), which can be seen from the formula 
below. 


f 2 

(. f 2 /g . -Mg) = 22 7r *~( 22 dijith - gj) - 7 * 0 *) 

Si ._/• 

1 

= 22 22 Wij — (9i-Sj)-J2 Wifi 

i J/i 9l i 

= 22 Wifi - 22 22 Wij^~9j - 22 naif 2 . 

... gi 

l l l 


We should verify whether the minus of two infinite series is of meaning. Let hi = fi/gi then 
hi > 0. The previous equation 


= 22 Wifi ~ 22 22 Wijfihd' L 

i i jz£i f 


22 Wifi 


< 


22w^i wijfifid + 2 


3+i 


hi hi 


22wifi -2222wnfifj -22wif 2 


i i jj?=i i 

£(f). 


22 wif? 


2) For the converse, if / > cf > 0, then it follows directly by taking g = f ■ If not, we let 
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fn = n 1 + /, then 


{f 2 /fn,-nf n ) = ^7T iqij (/? + /, 


2 

2 ->j 




fjfn(j) fjfnji) 

fn(i ) fn(j) 


Y Wifi 


{■£$> ~ ifij)h»«)-/««) -E*<'»/?• 




Since 


/ 




//) - /n(*)) > °> 


fn(j ) /«(*)' 

nf n -».oo(/ 2 //n: 

The last statement follows directly from the variational formula for £(f). 


by Fatou’s lemma, £(f) < liminf )WOO (/ 2 // n , -Slf n ) < sup g (f 2 /g,-Qg). 


To deal with the general ((-hj) and ( 7 ^), we need use the localization method to approximate 
the general situation. As \\f\\s is no longer a norm, the triangular inequality does not hold and 
so we have to approximate £(/) directly. 


Theorem 4.4 If there exists a measurable function g satisfying g > 0 and —£tg/g > A > 0, 
then Aq > A. 


Proof. For n, m € N, let 

Gnm = {r, 9i > 1/m, | 7 i| V % < n}, 

Anm = inf{£(/); /| GC = 0, / G 0(£)}. 

nm 

Let 

£nm{f) = ^ ^ fi) T ^ ?(*> G nm fj /j ^ ^ i'lifi : 

i,j £Gnm i^Gnm i(E.Gnm 

for / G L 2 (G nm , 7r). Then it holds that for /I _ e = 0, £(f) = £ n m{f ), and hence 

^nm 

A nm = inf{£ n m(/); ||/| G c II = 1, / G ^(£)}- 

y - r nm 

By this formula and the definition of Aq, we get 


Anm > Ao and hence lim A„ m > Ao- 

n,m—>00 
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For the converse, we have for any e > 0 there exists f e € S>{£) with ||/ e || = 1 such that 
Ao > £(fe) - £■ Let f nm = fe^-Gnm- w e shall show £(f nm ) £{f e )- Indeed, 

£{fnm ) = 2 ^ ^ ^ ^ i'Jifnmii ) 

i,j i 

= \ X 7r ifti(/j-/i) 2 + ^ 7r <9( i > G ^m)/i 2 - X] 

i'lj^Gnm i i£.Gnm 


We have 


IX>(i,GE ra )/?+ X 

£ TTil-Kl/? 0, 
z iGG c 

as n, m —> oo. So lim nim _ >00 £(f nm ) = £(/). This yields that Ao > lim^^^oo A nm —e, and hence 
Ao > lim^m^oo A nm by the arbitrariness of e. 

To complete the proof, we also need the following local operator. Let B be a measurable 
set, define for i £ B 

i f = Qh q?j = 

= X 0§/O') “ «?/(*) + 7»/(*)■ 

j6B 

If — Og > Ag then —fl B g > Xg on B for every measurable set R. Indeed, 

= X q ij g j ~ 9i + li9i 

3 

< X ViiSj - qi9i + < -A 9i, i € B. 

3 

Applying this fact to the set G nm , we get £} Gnrn g < — Xg on G nm . But on G nrn . qj and \^i\ are 
bounded and g is strictly positive, by Proposition 14.31 it holds X nm > A. As lim^^^oo X nm = Ao, 
we get Ao > A and the proof is complete. ■ 

Remark 4.5 We go back to see the argument of Theorem 14.21 If we can find a measurable g 
on M. such that g > 0 and Qg < —Xg for some A > 0, then we can define V(x,i) = gip(x) by 
this g. The inequality (13.51) holds with Aq replaced by A. Following the proof of Theorem 14.21 
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we can get that (X t ,A t ) is transient if lim^i^oo p(x) = 0. Under further condition on g, we get 
(X t ,A t ) is recurrent if liniM^oo p(x) = oo. The reason that we use Ao in Theorem 14.21 is that Ao 
is the largest desired one by Theorem 14.41 


At last, we give two examples of RSDP with switching in a countable state space to show 
the usefulness of our criteria. The Q-matrices of these two examples are unbounded. Especially, 
in the second example, the vector (yj) given by (A4) is also unbounded. 


Example 4.1 Let (Xt) satisfy the following stochastic differential equation, 

dX t = p\ t X t dt + d B t , X 0 = x 0 € R, (4.4) 

where (Bt) is a Brownian motion on R and (At) is a birth-death process on A4 = {0,1,...}. 
(At) and ( B t ) are mutually independent. Assume that go = —c, pt = 7 for i > 1, where c, 7 
are positive constants. Therefor, ( X f ^) is recurrent and (xjd) (i > 1) is transient. Assume 
qu+i = bt = b(i + 1) for i > 0, and qa-i = at = a(i + 1) for i > 1. Here the constants a and 
b satisfy a > b > 0, which ensures that (At) is reversible with respect to a probability measure 
(77) (cf. Van Doom [19]). The Q-matrix of birth-death process (At) is obviously unbounded. 
Then the process ( X tl At) is recurrent if c — b > 0 and a — b — 7 > 0. 


Indeed, it is easy to see that for each i £ M, 

_£,(*) = - A _ 1 - n -x— 

2 dx 2+ft d.r' 

Take p(x) = |x[, then it holds 

p(x) = pip(x ) for |x| > 1, i G M. 


Then we can take 7* = p t for i > 0 in the condition (Al). Define the bilinear form £(f) and its 
principal eigenvalue Ao as m and (13.21) . If c — b > 0 and a — b — 7 > 0, there exists a number 
A > 0 such that 

c — b > A > 0 and 0 — 6 — 7>A>0. 

Let gt = i + 1 for i > 0. We have 


£lg(i) = bi(g i+ i - g { ) + Oj^-i - gt) + pm 
= b(i + 1) - a(i + 1) + 7 (i + 1) 

< —A(z + 1) = —A gt, for i> 1, 

Dc/(0) = 60(51 - 9o) + 9-090 = (6 - c)g 0 < -\g 0 . 
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Applying Theorem 14.41 we get Ao > A > 0. Combining with the fact limM^^ p(x) = oo, it 
follows immediately from Theorem 14.21 and Remark 14.51 that (Xf,At) is recurrent. 

Example 4.2 Let (Xt) satisfy (14.41) with po < —1 and p % = i. (At) is a birth-death with birth 
rate 6y = 1 for all i > 0 and death rate a* > 1 + pi(i + 1) = i 2 + i + 1 for i > 1. Then the process 
(X t ,A t ) is recurrent. 

Indeed, it is easy to check that (A*) is reversible with respect to a probability measure (7Ty). 
Taking p{x) = |x|, we also have L^p(x) = pip{x) for |x[ > 1 and i > 0. Hence, = i for i > 1 
and f5i increases to oo as i —> oo. Setting gi = i + 1 for i > 0, it is easy to see that there exists 
A > 0 such that 


— go) — pogo < — ^gch 

bi(gi+ 1 gi) T O'iigi— i g%) T p%gi ^ A^y,. i > l. 

By Theorem 14.41 we have Ao > A > 0. Therefore, the process (Xt,At) is recurrent by Theorem 
ro and Remark 1431 


5 Summary 

In this work, we mainly studied the asymptotic stability in probability of regime-switching 
diffusion processes. Our switching process can be a Markov chain in a finite state space or in 
an infinite countable state space, and its switching rate can be state-independent and state- 
dependent. In particular, for switching in an infinite countable state space, we proposed two 
methods: one is the finite dimensional projection method, another is the principal eigenvalue 
method. Finite dimensional projection method can deal with state-dependent switching, but its 
switching rates must be bounded; the principal eigenvalue method can deal with switching with 
unbounded rates, but can not be used to deal with state-dependent switching at the present 
stage. Some concrete examples were constructed to show the usefulness and sharpness of our 
criteria. 

Acknowledgement The authors are very grateful to the referees for their valuable suggestions 
and comments. 
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